On Automorphisms of Markov Chains
نویسندگان
چکیده
We prove several theorems about automorphisms of Markov chains, using the weight-per-symbol polytope. Introduction The main purpose of this paper is to show how the weight-per-symbol polytope (WPS), introduced in [MT1, §3] can be used in the study of automorphisms (i.e., measure-preserving conjugacies) of Markov chains, in particular, with regard to the question of which permutations of finitely many periodic cycles can be realized by such automorphisms. In a Markov chain, the weight of a cycle is the product of the transition probabilities around the cycle. The weight-per-symbol (wps) of a cycle is its weight normalized by its length. We study the periods of the set of cycles with a given wps—in particular, with reference to how the given wps sits in WPS. In § 1, we establish the notion of a period for any wps which lies in the interior of WPS, and we compute this period. (The growth rate of the number of cycles with a given wps and length is computed in [MT2].) We also show that any given path is a subpath of some cycle with prescribed large least period and prescribed wps, provided the wps lies in the interior of WPS. The latter is used heavily later in the paper. While the results of §1 are also contained implicitly in [MT2], our proof here is a bit different and more direct. In [MT1, §3], a scaffold of Markov chains was associated to any given Markov chain: the scaffold consists of induced Markov chains, corresponding to the faces of WPS. In §2, we refine the scaffold by introducing boundary components, and using this we examine the set of (large) least periods of cycles with given wps in the boundary of WPS. In §3, we look at the permutation of boundary components induced by an automorphism of a Markov chain. We give a necessary condition in terms of shift equivalence for the existence of an automorphism that maps one boundary component to another. This gives a necessary and sufficient condition, though hard to check in general, for the existence of an "eventual" automorphism that realizes a given permutation of boundary components. We also explore inert automorphisms on Markov chains, introduced by Wagoner [Wa], and show that these automorphisms must fix each boundary component. From this, we see Received by the editors April 2, 1990. 1980 Mathematics Subject Classification (1985 Revision). Primary 28D20, 54H20, 58F20. ©1992 American Mathematical Society 0002-9947/92 $1.00+ $.25 per page
منابع مشابه
Empirical Bayes Estimation in Nonstationary Markov chains
Estimation procedures for nonstationary Markov chains appear to be relatively sparse. This work introduces empirical Bayes estimators for the transition probability matrix of a finite nonstationary Markov chain. The data are assumed to be of a panel study type in which each data set consists of a sequence of observations on N>=2 independent and identically dis...
متن کاملEvaluation of First and Second Markov Chains Sensitivity and Specificity as Statistical Approach for Prediction of Sequences of Genes in Virus Double Strand DNA Genomes
Growing amount of information on biological sequences has made application of statistical approaches necessary for modeling and estimation of their functions. In this paper, sensitivity and specificity of the first and second Markov chains for prediction of genes was evaluated using the complete double stranded DNA virus. There were two approaches for prediction of each Markov Model parameter,...
متن کاملThe Rate of Rényi Entropy for Irreducible Markov Chains
In this paper, we obtain the Rényi entropy rate for irreducible-aperiodic Markov chains with countable state space, using the theory of countable nonnegative matrices. We also obtain the bound for the rate of Rényi entropy of an irreducible Markov chain. Finally, we show that the bound for the Rényi entropy rate is the Shannon entropy rate.
متن کاملSuspension Flows over Vershik’s Automorphisms
The aim of this paper is to give a multiplicative asymptotics for the deviation of ergodic averages for certain classes of suspension flows over Vershik’s automorphisms [11, 13]. A corollary of the main result yields limit theorems for these flows. Informally, Vershik’s automorphisms (also sometimes called “adic transformations”) are dynamical systems whose orbits are leaves of the asymptotic f...
متن کاملStochastic Dynamic Programming with Markov Chains for Optimal Sustainable Control of the Forest Sector with Continuous Cover Forestry
We present a stochastic dynamic programming approach with Markov chains for optimal control of the forest sector. The forest is managed via continuous cover forestry and the complete system is sustainable. Forest industry production, logistic solutions and harvest levels are optimized based on the sequentially revealed states of the markets. Adaptive full system optimization is necessary for co...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1992